Papers by Roger E. Beaty
Diverse, not Short: A Length-Controlled Data Selection Strategy for Improving Response Diversity of Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Diverse language model responses are crucial for creative generation, open-ended tasks, and self-improvement training. |
| Approach: | They propose a length-controlled data selection strategy that improves diversity while maintaining length parity. |
| Outcome: | The proposed method improves diversity while maintaining length parity on LLaMA-3.1-8B and Olmo-2 family. |
Creative Preference Optimization (2025.findings-emnlp)
Copied to clipboard
Mete Ismayilzada, Antonio Laverghetta Jr., Simone A. Luchini, Reet Patel, Antoine Bosselut, Lonneke Van Der Plas, Roger E. Beaty
| Challenge: | Existing methods for enhancing LLM creativity focus on diversity or specific tasks, failing to address creativity’s multifaceted nature in a generalizable way. |
| Approach: | They propose a method that injects signals from multiple creativity dimensions into the preference optimization objective in a modular fashion. |
| Outcome: | The proposed method outperforms baseline models on automated and human evaluations while maintaining high output quality. |